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Abstract. We provide a generalization of the Schensted insertion algorithm 
for rc-graphs of Bergeron an Billcy J]j. The new algorithm is used to give a 
new proof of Pieri's formula. 



1. Introduction 

RC-graphs were first defined by Fomin and Kirillov |j| and later studied by 
Bergeron and Billey 0. These are a set of objects that encode the monomials 
contributing to the expansion of Schubert polynomials. These polynomilas were 
introduced by Lascoux and Schutzenberger [H M and described at length by Mac- 
donald g and by Manivel §. 

A central problem in the theory of Schubert polynomials is to provide effective 
ways of computing the generalized Littlewood-Richardson coefficients c" w in the 
expansion 

(1) PvPw = y ] C vw-Pv, 

a 

where P w is the Schubert polynomial of a permutation w. (We have used the fact 
that Schubert polynomials form a basis of all polynomials to get a unique such 
expansion.) 

The first attempt to compute the generalized Littlewood-Richardson coefficients 
using rc-graphs was made in Q|, where Monk's formula was proved using a gener- 
alized Schensted insertion algorithm. Later, in ||, this generalized algorithm was 
used to compute a more general set of Littlewood-Richardson coefficients. Unfor- 
tunately, this algorithm does not work in general and, in particular, fails to give 
a proof Pieri's formula. In this paper we will modify this algorithm to inserting 
a whole row of elements at once instead of an element by element insertion. This 
generalization will be used to prove Pieri's formula. 

Let us give a statement of Pieri's formula, whose different modifications have 
been conjectured in jfj], [Q and later proved in fill , |To|| , Q. 

Theorem 4.1. 

PwPa[r,m] = ^ ^ Pw' 

where the sum is over all w' — wt ait b 1 ...t am ^ m such that the bi 's are distinct and 
greater than r, a\ < 02 < ... < a m < r, satisfying l(w') — l(w) + m and w' '(bi) < 
w'(bj) < w 1 (ai) for every i < j with = aj. 

In the above statement, cr[r, m] stands for the permutation [1, 2, r— 1, r+m, r+ 
1, r + 2, ....]. Note that P CT [ rim ] is equal to the homogeneous symmetric polynomial 

hm (^1 ) ••*; -Er ) ■ 
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We will define Schubert polynomials, rc-graphs and point out their relationship 
in Section 2. The generalized insertion algorithm will be given in Section 3, while 
in Section 4 we will prove Pieri's formula by providing the inverse algorithm. 

2. RC-GRAPHS 

Let us decide on some notation and state some basic facts about permutations 
and Schubert polynomials first. For a permutation w £ S n , the symmetric group 
on n elements, we can write w as [u>i, ...,w n ], abbreviating w(i) to Wi. We let t a b 
denote the transposition which takes a to b and vice versa, leaving other elements 
fixed, and write Sj for t^j+i. It can be shown that s\, s n _i generate S n with the 
relations 

a? - 1, 
s t s J = SjSi if \i-j\ > 2, 

SiSi+lSi = Sj+lSjSj+l. 

For a permutation we S n ,we let the length l(w) of w be the number of inversions 
of w, i.e. the number of pairs (i, j) with i < j and w(i) > w(j). A string a\a2---a p 
such that s ai ...s ap — w with p minimal is called a shortest word for w. It can be 
shown that this p is just the length of w, and any two shortest word decompositions 
can be transformed into each other using the last two relations given above, i.e. that 
the graph of reduced words is transitive under the corresponding operations on the 
strings. Denote by R(w) the set of all the shortest words for w. 

This enables us to define Schubert polynomials. Let di be an operator which 
acting on a polynomial f(x\, ■■■,x n ) to the left, yields the polynomial 

f{x\, . .. , Xi : Xi+i , — , X n ) f{x\, . . ., Xi+i , Xj, ...x n ) 

x% x^+\ 

It can be verified that 

df = o, 

didj = djdi if \i - j\ > 2 
didi + \di = di + \didi + i 

Thus for any permutation w, we may define d w as d ai ...d ap , where a\...a p is any 
reduced word for w. Now the Schubert polynomial P w is defined to be 

1 w — u w~ 1 wo u 'l x 2 L n— l x n 

where w = [n, 1] is the longest word in S n . 

Now we come to rc-graphs. Given a reduced word a\...a p for w, we say that a 
sequence ai, a p is compatible for the word if 

ai < ct2 <■■■■< a p 

^ < ai, V i 
ai < a i+ i if a 4 < a l+1 

Denote by C(a) the set of all compatible sequences for a € R(w). 

Given such a compatible sequence we make an rc-graph by placing intersec- 
tions (see Figure 1) at all the positions (ak,au — a^ + 1), these form a subset of 
{1,2,...} x {1,2,...}. Now we draw strands starting at each row and winding their 
way up. Wherever there is an intersection symbol, we make the two strands there 
intersect. It is easy to show by induction that the intersections represent exactly 
the transpositions in the decomposition of w and that the strand starting at the i th 
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row ends up at the wf 1 column. Also, it follows from this that no two strands inter- 
sect twice, otherwise we could remove the 2 intersections and get exactly the same 
permutation, since any other pair of strands that intersected before still intersect. 
Then the word which led to the graph would not be reduced, a contradiction. Con- 
versely, given a graph with intersections such that no two strands intersect twice, 
this immediately gives us a reduced word for the permutation and also a compati- 
ble sequence (we look at the intersections in order of increasing row number, going 
from right to left in each row, the row number gives the and to get a% we add 
the row number and column number and subtract 1.) For more details see jjj. 

12345 12345 

1 + + . . . 1 — 

2 + . . . 2 — 

3 • • • 3 — ' 

4 + . 4 — 

5 . 5— J 




Figure 1: Two ways of drawing an rc-graph. 

Denote by %Q{w) the set of all rc-graphs, which correspond to w. For D £ JiC(w) 
let x D — Ylt ak a k -a k +i)eD Xa k- Now we state a theorem proved in g and in [Q. 



Theorem 2.1. For any permutation w S S, 



oc ■ 



P w S ' S ' X ai ...X ap S ' X 

a.£R(w) ai...a„eC(a) DeJie(w) 

On an rc-graph we can define a ladder move (of size m) as shown in the figure. 
Note that after the move we get an rc-graph corresponding to the same permuta- 
tion (since the minimal number of intersections is preserved and the same strands 
intersect in the two figures). 



. . . + 

+ + + + 



+ + + + 
+ . . . 



Figure 2: Ladder moves 

We shall call the inverse operation an inverse ladder move. Billey and Bergeron in 
(lj prove that all graphs in 3lQ(w) can be obtained by applying a succession of ladder 
moves to Db ot (w) — {(i, c) : c < m,} (where m, = #{j : j > i and wj > u>i}), 
which is the "bottom" rc-graph corresponding to w. Note that the bottom graph 
has the property that the rows are left-justified. For instance, the graph shown in 
Figure 1 is a bottom graph. 
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3. Generalizing insertion algorithm. 

Recall that Pieri's rule seeks to give a formula for multiplication of a Schubert 
polynomial with P a [ r<m ] (a homogeneous symmetric polynomial). In other words, 
it computes the generalized Littlewood- Richardson coefficients c" w for w — a[r,m], 
where the coefficients are define by 

p p — \^ c u p 

u 

To enable us to find this formula, we need a modification of the insertion algorithm, 
which was defined in Q and used to compute some set of Littlewood-Richardson 
coefficients in [|] 

Notice that each rc-graph for the permutation a[r, m] can be given by specifying 
the number of intersections in the rows on or above row r. Assume this rc-graph is 
given by k s elements in the row i s , where i± > %2 > ■■■ > it and ^2 k s — m. Below 
is the algorithm which inserts this rc-graph into a general rc-graph. 

Algorithm: Given an rc-graph D, and a level r, suppose we have to insert k s 
elements into row i s , where i\ > 12 > ■■• > it into D (r > i{). We keep an ordered 
sequence of (a*, 6j)'s during the course of the algorithm, such that a\ < 02 < ... < a/ 
and all frj's are distinct. Initially the sequence is empty. 

Proceed row by row as follows. Starting with row i\, find the rightmost position 
where the configuration is one of the following, as shown in Figure 3: 

I with s < r < t, I with r < t, 

s — } , — o, — ', — 

I 1 7^ bj for any j. | t ^ bj for any j. 

t t 

Figure 3. 

Add this intersection. If we are in the first case, to the list of (a, b)'s add (s, t). 
To preserve the order of a^'s, if s is equal to some a, = ... = a^+fc, place (s, t) at the 
i + k + 1 place. If we are in the second case add (at, t) just before where (a*, 6j) is 
in the sequence. Proceed to do the same for the other intersections on the row i\. 
Now we have a sequence of strands ax, 61, , bk x where we know for sure that 
the bi's are distinct and ai's are ordered. Also, the graph we have obtained might 
not be an rc-graph. So we go to the next row and perform the following rectification 
procedure. Starting from the left, we look for either of the two configurations: 

with a,i = dj. 



Figure 4. 



We remove the intersection, delete the pair (aj, bi) from the sequence of (a, b)'s. 
If the intersection was at position find the maximal j' < j such that the 

configuration at is of the form shown in Figure 3. (Such a position must be 

encountered since the bi we removed is greater than r and no longer a bi, also the 
row number is less than r.) We add the intersection and to the list of (a, 6)'s, we 
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add this new pair the same way it was described before. Then we look to the right 
to see if there is another intersection of the form given in Figure 4, and rectify 
that, and so on. When we are done with rectifying the intersections, we add what 
intersections we must to this row in the same manner as for the previous row, 
giving us some new pairs (aj, bj). We then proceed to the next row and repeat the 
procedure. It is clear from the construction that the b's remain distinct and a's 
remain ordered. □ 
The rest of this section is concerned with proving the following: 

Theorem 3.1. The above algorithm produces an re- graph. 

We show this by induction: we'll show that after dealing with a row I (rectifying 
it and inserting elements), the part of the graph below and including that row is 
an rc-graph (i.e. no two elements intersect twice). Assume the this is true for the 
row I + 1 . 

Wc will need a couple of lemmas and another algorithm first. 

Lemma 3.2. Assume we are the moment of the algorithm when we rectifying row 
I of the graph. Assume that at this moment a = a,{ = ... = di+k- Then at the 
row I, the strands bi, bi+k are to the left to the strand a and they are ordered in 
this row, the same way they are orderen in the (a,b) seguence. (See Figure 5 for 
illustration.) 



row t 




h • b i+k a 



Figure 5. The order of fej's strands at the row I is the same as in the (a, b) sequence. 

Proof: This is a trivial proof by induction. Clearly the order of starnds a 
and bi, ...,b i+ k in the row I can change only when any of them intersect, but such 
intersections are shown on Figure 4 and they are removed during the algorithm. At 
the same time, whem an intersection is added the addition of (a,j, bj) to the list is 
consistent with order of the starnds a and bi, ...,b i+ k in the row I. □ 

Lemma 3.3. The permutation carried by the strands of the graph at each moment 
of the algorithm is wt ai b l ...ta m ,b m , where < (ai,bi),...,(a m >,b m i) > is the sequence 
upto that point in the algorithm. 

Proof: We again use induction: we need to check the above statement remains 
true when we insert an intersection or delete one. 

If we are in the first case of Figure 3, that is we are adding an intersection and 
(s, t) to the list of (a, b)'s. We can easily see that adding this intersection multiplies 
the permutation of the graph by i Sjt on the right. So, if < (ai, b\), {a m >,b m i) > 
is the list before this insertion, the permutation of the graph after the insertion is 
wta^-.ta ,b m ,ta,t- Using the fact that t a b and t c d commute when a,b,c,d are all 
distinct, we can move t Sjt trough t^fa —t a ,b m i to the left until some aj < s. But 
this is exactly how the algorithm changes the list of (a, b)'s. 

If we are in the second situation of Figure 3, then we multiply the permutation 
w ta 1 b 1 ---ta m ,b m , by tb u t on the right. Then t^.t can be moved to the left until the 
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place i, since all bj's are distinct and thus t^.t commutes with all t aj ,j 3j if j > i. 
After that we use the following identity, which shows why we have to add (a*, t) to 
the (a, b) list on the i th place: 

ta,bitbi,j — ta,jta,bi' 

Finally for the deletion, we use almost identical arguments in both cases of Figure 
4, since the deletion of an intersection also multiplies the permutation of the graph 
by appropriate transposition. The only difference is in the second case, when we 
have to use the following trivial identity: 

ta 7 bita,bjtbi,bj ^a,bj 

This concludes the proof of the Lemma. □ 
To give a proof of Theorem 3.1 we have to introduce another algorithm (call it 
algorithm 2) that we perform on the intermediate graph. This algorithm will take 
the graph, which was rectified upto the row £, and remove some intersections to 
produce an rc-graph of the original permutation w. 

Algorithm 2. We start with the list of (a,i,bi)'s and starting with the last row 
£ we have finished with, go down one row by one and from right to left in each row. 
We look for intersections of the form 



with a,i = a 



j ■ 



Figure 6. 



Whenever we see these, we remove the intersection and (ai,bi) from its place 
in the list. Note that both statements of Lemma |3.2| and Lemma 3.2 hold at each 
moment of this algorithm. Ultimately all the (ai,bi) will be removed from the 
list because each strand Qi definitely intersects the strand bi at each moment of 



algorithm 2 by Lemma 3.2, so all of them will get removed and at the end we will 



get a graph and an empty list of (a, 6)'s. □ 
Now the result of algorithm 2 will be a graph with the permutation w by Lemma 
3.3, with exactly l(w) intersections. Therefore it will be an rc-graph for w. We will 
use this fact to prove that the main algorithm gen erates an rc-graph. 

Now, we come back to the proof of Theorem 3T . Suppose we have rectified some 
row and inserted some elements in it, and we want to show there are no double 
intersections below and including that row. Because of the inductive hypothesis, 
this works for the previous row £ + 1 (base case for the first row is clear) . Hence 
we only need to check that we have no double intersections in the row £, after thiw 
has been rectified. 

We will show that the only double intersection which might be introduced in the 
row £ by insertions in the lower rows will get removed by the algorithm and no new 
double intersections will be introduced in this row or any of the lower rows. 

Let us show that after rectifying row £+1, and deleting all the intersections from 
figure 4 in the row I at once, there are no strands, which intersect twice below row 
I. For this apply Algorithm 2 to the graph constructed after rectifying row £ + 1 . 
Then the resulting graph is an rc-graph D of the permutation w. Start applying 
the inverse of Algorithm 2 to this rc-graph D, that is stard adding intesections to 
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D in the opposite order they were removed. It is then not difficult to see that since 
we are only adding intersections from Figure 6 and at each moment there are no 
double intersections below row £ + 1, the only double intersections at the row £ have 
to look like the ones on Figure 4. This shows that removing intersections from row 
£ we remove all the double intersection below this row. 

Now let's check that after adding the intersections in the row £ we do not get 
new double intersections. Clearly the only way we could have done this is if we 
inserted an intersection in the position as in the second case of Figure 3, so that 
the strands b t and t intersected before, in a lower row. (In the first case of Figure 
3, the two strands could not have intersected in a lower row, since s < t.) So, we 
shall show that in the first case the strands bi and t cannot intersect in a lower row, 



that is bi < t. Proving this will finish the proof of Theorem 3.1 



After the row £ is rectified, we again apply Algorithm 2. Notice that this algo- 
rithm keeps moving the strand bi to the left in the row £ till the last point, where it 
is removed off the list of (aj, 6j)'s, at which point it moves right, even to the right of 
its original position. For example, in Figure 7, the circled intersections are opened 
during Algorithm 2. When the first one is opened, bj is removed from the list and 
bi moves from x to the left, to z, and when the second intersection is opened, bi is 
removed and it moves to the right of x, to y. 

z x y 



row 



s 



bi bi 



Figure 7. During Algorithm 2, bi moved from x to z and then to y in the row £. 

Therefore the position x of the strand bi at the row I at the start of Algorithm 
2 is to the left of the position y at the row £ at the end of it. 

Now we look at what happens after the bi is moved off the list in Algorithm 2, 
possibly by some 6^ (first it moved from x to z and then from z to y in the row 
I). We look next at the history of bi 2 till it is moved of the list and so on, getting 
a figure like the following. 



z x y 



row £ 




region 



a b l2 b i± bi 



Figure 8. No strands between a and bi can pass in the shown region between z and y. 
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Note that no two consecutive strands shown in the figure can intersect above the 
encircled spot (where one of them is moved off the list), because that intersection 
would then have to be removed earlier than the encircled one, by construction of 
the algorithm 2. Therefore, from the fact that the outcome of algorithm 2 is an 
rc-graph, we conclude that in the region shown, there can pass no strand between 
a and hi (otherwise some double intersections must occur). Hence the t from the 
second case of Figure 3 must always be greater than 6j. This concludes the proof 



of Theorem 3.1 



Remark 3.4. Assume that the permutation w satisfies the following condition 
w(i + 1) > w(i) if i > r. Each rc-graph of such a permutatios has the following 
defining property: no two strand, which start below row r intersect. In this case it 
can be shown that the above algorithm is equivalent to one by one insertion. This 
is consistent with the results in || , where the Pieri formula in this special case was 
proved using the one by one insertion. The above statement and the fact that one 
by one insertion does not work in general indicate that this algorithm provides the 
proper generalization of Bergeron-Billey algorithm of [jjj . 



4. The proof of Pieri's formula. 

To prove Pieri's formula using the above insertion algorithm, we will construct 
an inverse algorithm, which takes an rc-graph for w' — wt ait t )1 ...t am) t )m , such that 
the &i's are distinct and greater than r, a% < 02 < ... < a m < r, satisfying l(w') = 
l(w) + m and w'ibi) < w'(bj) < it/ (a*) for every i < j such that = a,j, and 
produces an rc-graph for w and an rc-graph for o~[r, n] (remember, that rc-graphs 
of <j[r,m] are given by specifying the number of intersections k s in in each row 
s < r, such that ^ k s — m). Given the insertion algorithm and its inverse, we will 
clearly produce a bijection: 

fte(w) x {k u ...,k r : = m} = %e(w) x %e(a[r,n]) -+\J$.(w') 

where w' ranges as stated above. 

Below we will produce this inverse algorithm, which will automatically prove the 
following 

Theorem 4.1. 

PwP<j[r,m] = ^ ] Pw' 

where the sum is over all w' — wt ait i >1 ...t am ^ m such that the bi 's are distinct and 
greater than r, a\ < ai < ... < a m < r, satisfying l(w') = l(w) + m and w'(bi) < 
w'(bj) < w'(a,i) for every i < j with di — dj. 

Inverse Algorithm. 

We are given an rc-graph R' for a permutation w' — wt ai t >1 ...t am t >m with the 
distinct bj's, which are greater than r and with a\ < 02... < a m < r, l(w') = 
l(w) + m, and w'(a) > w'(b) > w'(c) for all a,b,c such that (a,b) is some (a s ,b s ) 
and (a,c) is some (at,bt) with s > t. The algorithm is defined as follows: starting 
from the top (first) row of the rc-graph, we look from right to left for the occurrence 
of one of the configurations shown below. 
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with a. 



J ! 



Figure 9. 

We then remove this intersection from the rc-graph and consequently remove 
(dj,&j) from the list of (a, 6)'s. Immediately after we remove such an intersection 
we look to its right for a configuration of the form 

I with s < r < t, I with r < t, 

t—>(— ~ t —>f— 

| t ^ bi for any i. \ 1 7= bj for any j. 



Figure 10. 

If we don't find such a configuration, we move on with the algorithm, looking left 
along that row (and after that, going to the next row) for an intersection of the form 
shown. (At the same time we record the number of this row, as the numbers of these 
rows will give an rc-graph for a[r, m] at the end of the algorithm.) If we find such 
a configuration, we add the intersection at this place (i.e. the first configuration of 
this sort, looking to the right of the removed intersection) and add (r, s) or (<2j,i) 
to the list of (a, 6)'s the same way it was done in the forward insertion algorithm, 
i.e we add (r, s) to be (at, bi) to preserve the order of a's (dj_i < a, < ffli+i) and we 
add (a,, t) right after (oj, bj). Then we proceed with the algorithm, looking left for 
more intersections to remove. We do this till the list of (a,b)'s becomes empty. At 
the end we are left with a graph for the permuation w. Moreover, the previously 
recorded rows, where intersections were removed from the rc-graph, produce an 
rc-graph for a[r, to]. 

The fact that he resulting graph is an rc-graph can be shown using the same sort 
of technique used for the forward algorithm. It is also evident that the algorithm 



is the inverse of the forward algorithm. This finishes the proof of Theorem 4.1 
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